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DETAILED ACTION 
Claim Rejections - 35 USC §112 

The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

Claims 2 and 18 are rejected under 35 U.S.C. 112, first paragraph, as failing to 
comply with the enablement requirement. The claim(s) contains subject matter which 
was not described in the specification in such a way as to enable one skilled in the art to 
which it pertains, or with which it is most nearly connected, to make and/or use the 
invention. The limitation "the application of the warping tool defining a distortion vector 
at each of one ore more image regions based on the shape and the vectors" recited in 
both claim 2 and 18 is not described in the specification. The closest disclosure in the 
specification for enabling the above limitation is found on page 4, lines 1 1 - 12, "A 
warping effect is applied to the covered pixels based at least in part on the warping tool 
vector or vectors..." Although the description in the specification states that the warping 
effect is applied at least in part on the warping tool vector or vectors such that the 
application of the warping tool may be based upon factors other than the vectors, there 
is no mentioning in the specification teaching how the warping tool could be effected by 
the shape of the warping tool. In regards to the rejection of claims 2 and 1 8, the 
application of the warping tool based on the shape is interpreted to mean that the shape 
of the warping tool dictates the points of an image that are to be included in the warping 
tool. A larger shaped warping tool includes points that are farther away from a warped 
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point than a smaller shaped warping tool. By applying strength fields to the warping 
application, the distance a point is from a warped point will affect the amount of 
deformation on that portion of the image. In this way, the application of the warping tool 
is based on the shape and the vectors. 

Claim Rejections - 35 USC § 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

Claims 1, 2, 6 - 9, 17, 18, 22 - 25 are rejected under 35 U.S.C. 102(b) as being 
anticipated by U.S. PGPUB No. 2004/0056871 to Milliron. 

In regard to claim 1, Milliron discloses a method, apparatus, and computer 
program product for performing geometric warps and deformations. Paragraphs 72 and 
75 of Milliron describe a vertex mesh in which a warping function will move the vertices 
of the mesh to new positions in space. Paragraph 75 states, "One simple deforming 
function convenient in some instances is a displacement] model. For instance, the 
output of the warp may be generated with a vector-valued function defined on the 
domain U. The displacement model can then be added to the undeformed model to 
yield the deformed model." Thus, the warping tool of Milliron includes having one or 
more associated vectors, each of the vectors originating at a mesh point defined by a 
tool mesh associated with the warping tool. Paragraph 181 further describes the 
deformation meshes as being of any arbitrary topology and genus. "To further illustrate 
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our mesh warp, the following points are noted about a preferred embodiment: First, our 
warp allows deformation meshes of arbitrary topology and genus to be used... Thirdly, 
our warp is defined spatially. This means that to create a deformation on an object, the 
only requirement is that the deformation mesh be located near the object to be 
deformed." An example of a deformation mesh containing a figure can be seen in 
Figures 2A and 2B. As can be seen, the mesh warping tool has a perimeter, shape, 
and a size. Paragraph 77 states, "The invention is not limited to particular types of 
features. In preferred embodiments a warp designer selects the set of feature 
specifications; this aspect is limited only by the warp designer's ingenuity." Paragraph 
118 discloses, "An illustrative implementation could involve a warp designer specifying 
each of n transformations strength field and weighing fields as a vector with m scalar 
elements (where m is a discrete number of model points, i.e. one value per point)." 
Paragraph 119 additionally states, "Independent of construction function, the warp 
designer preferably specifies a sampling algorithm used by the sampling function 7450. 
No particular sampling algorithm is fundamental to carrying on the invention. The best 
sampling algorithm depends on the needs of the warp designer and the model 
representation. In some instances uniform sampling could be used, as could adaptive 
methods such as quad trees or irregular sampling. The sampling function 7450 
receives the set of parameterized transformations 7300, the set of strength fields 7350, 
the set of weighting fields 7400 and the undeformed model 7150 and uses the sampling 
algorithm to output a set of discretized transformations 7500, a set of sampled strength 
fields 7550, and a set of sampled weighting fields 7600." Lastly, Paragraph 70 states, 
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"The computer system 1000 also comprises an input/output device controller 1400 
communicatively coupled with the bus 1600 and configured for controlling input/output 
from devices. The input/output device controller 1400 may operate with, for instance, a 
keyboard 1710, a display 1720, a data network 1730, and a pointing device 1740." 
Therefore, Milliron teaches of specifying one or more of the shape of the perimeter, the 
tool mesh, and the associated vectors of a warping function by user input by allowing a 
warp designer to specify strength and weighing fields as a vector with scalar elements. 

In regard to claim 2, Paragraph 76 states, "Further in accordance with the 
illustrative embodiment, a set of feature specifications is used to represent mappings 
from source to target features. Each of the set of feature specifications comprises a 
source feature, a target feature, and related deformation parameters for controlling 
deformation caused by the feature specification. In some instances the number of 
related deformation parameters may be zero. Again, as noted above, some 
embodiments of the invention are not feature based and, in such case, a parameter set 
is used for controlling the warp." As stated above in the rejection of claim 1, a designer 
inputs the feature specifications for an image region in which to perform a warping 
function. Paragraph 77 further states, "The invention is not limited to particular types of 
features. In preferred embodiments a warp designer selects the set of feature 
specifications; this aspect is limited only by the warp designer's ingenuity." Paragraphs 
79 and 80 describe the warp shown in Figures 2A and 2B. A constant translation is 
calculated to create a deforming function to map a point from a source position to a 
target position. As can be seen in Figures 2A and 2B, the application of the warping 
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tool and the deforming function modifies the image of Figure 2A with the deforming 
function so that the image is now located in its new target location as shown in Figure 
2B. Paragraph 81 and 82 further describe the use of strength fields in computing the 
deformed model by scaling the magnitude of each of the set of transformations over 
elements of the undeformed model. Paragraphs 92, 93, and 94 describe performing a 
warping application on oriented points from a source coordinate frame to a target 
coordinate frame. As stated in Paragraph 94, "The warp designer may describe T.sub.i 
directly by specifying how it maps frame origins and basis vectors. In addition, the warp 
designer may describe the transformation as an ordered composition, for instance of 
translate, rotate, scale, and shear components." Paragraphs 81 through 90 describe 
the use of scaling and weighting functions and their radial fall-off feature such that their 
influence over a set of transformations decreases as the distance from the feature in the 
image increases. Lastly, Paragraph 96 describes performing a warping function to 
three locations on an image as can be seen in Figures 5A and 5B. Thus, the 
application of the warping tool defines a translation function used to create a deforming 
transformation function that corresponds to a distortion vector at each of the one or 
more image regions. The deforming function is based on the shape, the shape dictating 
the distance from a scaled source point and another point on the source image and 
therefore the deforming function at the remote point, and the calculated translation. 
Furthermore, Milliron applies the warping tool to an image having one ore more image 
regions in response to user input to define a set of feature specifications. As shown in 
Figures 2A and 2B and Figures 5A and 5B, the one or more image regions as described 
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above are modified using the corresponding transformation function, thus teaching of 
modifying the one or more image regions using the corresponding distortion vectors. 

In regard to claim 6, Paragraph 77 states, "The invention is not limited to 
particular types of features. In preferred embodiments a warp designer selects the set 
of feature specifications; this aspect is limited only by the warp designer's ingenuity." 
Paragraph 79 discloses, "A simple version of the invention will now be described to 
illustrate basic aspects of the invention. In this version the set of feature specifications 
consists of a single element and the single element is a point feature. The warp maps 
the point feature, from its source position, P, to its target position, P\ This 
transformation is a constant translation, T=P'-P." Additionally, Paragraph 118 states, 
"An illustrative implementation could involve a warp designer specifying each of n 
transformations strength field and weighing fields as a vector with m scalar elements 
(where m is a discrete number of model points, i.e. one value per point)." Thus, Milliron 
teaches of receiving user input defining a strength and/or direction of the one or more 
associated vectors. 

In regard to claim 7, Figure 3A shows an image to be modified with an applied 
strength field. As noted above in response to claim 6, Milliron teaches of receiving user 
input defining the strength of the one or more associated vectors. As can be seen in 
Figure 3A and the resulting modified image of Figure 3B, the distribution for the strength 
of the transformation is defined to be rotationally asymmetric. Thus, Milliron discloses 
receiving user input defining a rotationally asymmetric distribution for the strengths. 
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In regard to claim 8, Figure 4A shows an image in which two points are to be 
modified. As noted above in response to claim 6, Milliron teaches of receiving user 
input defining the strength and/or direction of the one or more associated vectors. As 
can be seen in Figures 4A and the resulting modified image of Figure 4B, the 
distribution for the directions in the warped application are defined to be rotationally 
asymmetric. 

In regard to claim 9, Paragraphs 216 through 222 describe altering strength fields 
and weighting fields in a warp application such that they vary over time. Paragraph 216 
states, "Many desirable applications of warping in morphing and animation involve 
controlling the evolution of a warp over time. Yet another aspect of the present 
invention involves aspects for controlling the evolution of a warp over time." Paragraph 
222 further states, "One skilled in the art having the benefit of this disclosure will 
appreciated that features of the invention may be used to create deformations varying 
over time through varying, for instance, strength fields, weighting fields, parameterized 
transformations, or features themselves." Therefore, Milliron includes receiving user 
input defining a strength and/or direction that change with time. 

In regard to claim 17, the same basis and rationale for claim rejection as applied 
to claim 1 is applied. Additionally, Paragraphs 69 and 70 further describe the invention 
of Milliron as being tangibly embodied on the computer-usable storage medium, 
element 1755 of Figure 1, either in source code or compiled form. Paragraph 70 states, 
'The computer-usable storage medium 1755 having code for suitable configuring the 
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computer system 1000 to carry on features and/or perform functions in accordance with 
the invention may be a made and used in any conventional way." 

In regard to claim 18, the same basis and rationale for claim rejection as applied 
to claim 2 is applied. Additionally, Paragraph 70 states, 'The computer-usable storage 
medium 1755 having code for suitable configuring the computer system 1000 to carry 
on features and/or perform functions in accordance with the invention may be a made 
and used in any conventional way." Thus, Milliron teaches of configuring a computer 
system for performing the functions of the invention, thus corresponding to instructions 
operable to cause the data processing equipment to perform the functions of the 
invention. 

In regard to claim 22, the same basis and rationale for claim rejection as applied 
to claim 6 is applied. 

In regard to claim 23, the same basis and rationale for claim rejection as applied 
to claim 7 is applied. 

In regard to claim 24, the same basis and rationale for claim rejection as applied 
to claim 8 is applied. 

In regard to claim 25, the same basis and rationale for claim rejection as applied 
to claim 9 is applied. 

Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
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invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

Claims 3 -5, 10-16, 19-21, and 26-32 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over U.S. PGPUB No. 2004/0056871 to Milliron in view of U.S. 
PGPUB No. 2002/0089500 to Jennings et al. 

In regard to claim 3, since Milliron does not pose any limitations on the images 
with which to deform or warp, it is obvious in the invention of Milliron that the applying 
and modifying to produce a warping effect can be repeated on an already warped 
image. However, Milliron does not explicitly disclose the ability to repeat the applying 
and modifying of a warping function to produce a warping effect. The invention of 
Jennings et al. discloses a method and system for modeling a virtual object in a 
computer environment that undergoes transformations as a consequence of a user 
interacting with the virtual object in which the user may perform multiple modifications to 
the object. Paragraphs 68 and 69 of Jennings describe the ability of a user to perform a 
second modification operation on an object that has already undergone a previous 
modification. Paragraph 69 states, "The resulting volume 620 can have characteristics 
that represent the first modification further modified by the second modification. 
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Because the modification process can be performed iteratively, it is possible to apply as 
many discrete modifications as the user of the system elects to perform. When the user 
indicates that the result is satisfactory, the system performs the operations of 
transforming the intermediate representation to a model representation, as discussed 
with regard to FIG. 4." It would have been obvious to one having ordinary skill in the art 
at the time the invention was made to modify the invention of Milliron to include 
repeating the applying and modifying of an object in response to a warping function to 
produce a warping effect as in Jennings et al. One would have been motivated to make 
such a modification to Milliron so that a user may be able to repeatedly modify a source 
object until they are satisfied with the result of the warping function. Additionally, by 
allowing a user to perform another warping function on an already warped image, the 
user may be able to reduce or increase the previous modification if they desire. 

In regard to claim 4, Milliron teaches of a system including a display monitor, 
element 1 720 of Figure 1 . It is very well known in the art of computer graphics to 
display a representation of a modified image on a display monitor to allow a user to view 
the results of a warping function on an image. However, Milliron does not explicitly 
disclose displaying a representation of the modified image. Jennings et al., as 
described above, in Paragraph 61 states, "The changes can optionally be visualized by 
providing a visual representation at any time, including in real time, as the modifications 
are performed by a user of the system." It would have been obvious to one having 
ordinary skill in the art at the time the invention was made to modify the invention of 
Milliron to include displaying a representation of the modified image as in Jennings et al. 
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One would have been motivated to make such a modification to the invention of Milliron 
so that a user could visualize the modifications the warping function performs on an 
object in real time while executing the warp application to determine what the results of 
the warp will look like. 

In regard to claim 5, although the warping method of Milliron includes the use of 
a mesh tool, there is no teaching of receiving user input to specify the tool mesh. 
Paragraph 64 of Jennings et al. discloses, "The user selects (or activates) the "Warp" 
computer command, whereupon the system creates an editable mesh corresponding to 
the surface selected by the user in FIG. 3A." It would have been obvious to one having 
ordinary skill in the art at the time the invention was made to further modify the invention 
of Milliron to include receiving user input specifying the tool mesh as in Jennings et al. 
One would have been motivated to make such a modification to Milliron so that a user 
may selectively use the warping program only in instances when a warping function is 
desired. Additionally, a program running on a typical computer system requires storage 
in system memory and processing time. By giving a user the ability to activate the 
warping program when its function is needed instead of having the program constantly 
run in the background of a graphical editing program, system resources can be 
preserved. 

In regards to claims 10, 11, and 13, Milliron does not teach of specifying the 
shape of the perimeter of a warping tool. Jennings et al. discloses in Paragraph 73 of 
selecting a region to be modified by the user. "In different embodiments, the selection 
step 720 can include, but is not limited to, specification of a sub-volume using an 
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interactively positioned tool with a region of influence. In one embodiment, the 
interactively positioned tool is a user controlled stylus, and the region of influence is 
determined by a user-controllable radius. In one embodiment, the position specification 
of a portion of the model to be modified is performed in conjunction with the projection 
of a user-positionable two-dimensional image onto the model. In one embodiment, the 
specification of a portion of the model to be modified is accomplished by drawing a 
closed curve on the region to be modified, for example using a pointing device such as 
a mouse or a stylus." Thus, Jennings teaches of allowing a user to specify the shape of 
the perimeter of an area to be modified by drawing a closed curve on the area. It is well 
known in the art that a perimeter area drawn by a user with a pointing device may be of 
any shape including a triangle, square, hexagon, octagon, rhombus, or a rotationally 
asymmetric shape. It would have been obvious to one having ordinary skill in the art at 
the time the invention was made to further modify the invention of Milliron to include 
receiving user input specifying the shape of the perimeter of the warping tool as in 
Jennings et al. One would have been motivated to make such a modification to Milliron 
so that a user may be able to perform a localized warping function on a subset of an 
image by drawing the warping tool around the area of interest without affecting the rest 
of the image. Additionally, element 81 1 of Figure 8, shows a bounding box in the shape 
of a square for marking the specified region with which to apply a deformation. 

In regard to claim 12, the same basis and rationale for claim rejection as applied 
to claims 10, 11, and 13 are applied. However, Milliron does not disclose receiving user 
input specifying a shape of the perimeter and/or a size that changes with time. 
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Paragraph 77 of Milliron, though, does teach of allowing a warp designer to select 
feature specifications for performing a warping function. "The invention is not limited to 
particular types of features. In preferred embodiments a warp designer selects the set of 
feature specifications; this aspect is limited only by the warp designer's ingenuity." 
Furthermore, it is obvious to one skilled in the art that specifications for a warp may be 
time varying. Paragraphs 216 through 222 teach of altering strength fields and other 
parameters with time. Paragraph 222 states, "One skilled in the art having the benefit of 
this disclosure will appreciated that features of the invention may be used to create 
deformations varying over time through varying, for instance, strength fields, weighting 
fields, parameterized transformations, or features themselves." Thus, Milliron 
additionally teaches that the features themselves may be time varying in a warping 
application. It would have been obvious to one having ordinary skill at the time the 
invention was made to further modify the invention of Milliron to include changing the 
size or shape of the perimeter of a warping tool with time. One would have been 
motivated to make such a modification to Milliron so that a warp designer can be further 
controlling with respect to the warping application. As stated above, the invention of 
Milliron teaches that the warp designer is able to select the set of feature specifications, 
limited only by their ingenuity, for performing a warping function. By allowing the shape 
and/or size of the perimeter of the warping area to vary over time, the warp designer 
may be better able to perform a localized warping function on a subset of an image 
without affecting the rest of the image or may create a warp that starts as a localized 
function then spreads throughout the rest of the image as time progresses. ' 
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In regard to claim 14, Figure 2A of Milliron depicts a movement of a point on the 
warp map, element 2200, from its source location to a target location, element 2300. 
Figure 2B shows the effect of applying the warp tool in response to a designer input 
defining a movement of a point in the warp map from a first location to a second location 
relative to the image, thus corresponding to applying the warping tool in response to 
user input defining a movement of the warping tool from a first location to a second 
location relative to the image. 

In regard to claim 15, Paragraph 79 of Milliron states, "In this version the set of 
feature specifications consists of a single element and the single element is a point 
feature. The warp maps the point feature, from its source position, P, to its target 
position, P\ This transformation is a constant translation, T=P'-P. Equation 2 represents 
the resulting deforming function: D(u,M)=T." Paragraph 94 further states, "The warp 
designer may describe T.sub.i directly by specifying how it maps frame origins and 
basis vectors. In addition, the warp designer may describe the transformation as an 
ordered composition, for instance of translate, rotate, scale, and shear components. 
The particular manner in which the transformation is described is not fundamental and 
is limited only by the ingenuity of the warp designer." Paragraph 118 describes, "An 
illustrative implementation could involve a warp designer specifying each of n 
transformations strength field and weighing fields as a vector with m scalar elements 
(where m is a discrete number of model points, i.e. one value per point). Assembling 
these n m-vectors into an n by m matrix provides an interpretation where each row 
corresponds to a transformation. The matrix then can be viewed as a matrix of 
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coefficients of a system of equations that can be solved for field or transformation 
values." Paragraph 119 states, "The sampling function 7450 receives the set of 
parameterized transformations 7300, the set of strength fields 7350, the set of weighting 
fields 7400 and the undeformed model 7150 and uses the sampling algorithm to output 
a set of discretized transformations 7500, a set of sampled strength fields 7550, and a 
set of sampled weighting fields 7600. The output quantities are defined on a domain of 
model points U." Lastly, Paragraph 120 states, "These discretized quantities are 
passed to a 'discretized warp computation' process 7700 that uses Equation 6 to 
compute the deforming function 7750." Therefore, a deforming function corresponding 
to a distortion vector is calculated for an image region based on the movement of a 
point in the warp map from a first location to a second location and one or more 
associated vectors defining a strength field. Figure 3A shows a movement of a point on 
the warp map, element 3100, from its source location to a target location, element 3200, 
in addition to a strength field located at the source location. Figure 3B shows the effect 
of applying the warp tool in response to a designer input defining a movement of a point 
in the warp map from a first location to a second location relative to the image and one 
or more associated vectors defining a strength field. 

In regard to claim 16, Paragraph 77 of Milliron states, "The invention is not limited 
to particular types of features. In preferred embodiments a warp designer selects the set 
of feature specifications; this aspect is limited only by the warp designer's ingenuity." 
Paragraph 118 describes, "An illustrative implementation could involve a warp designer 
specifying each of n transformations strength field and weighing fields as a vector with 
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m scalar elements (where m is a discrete number of model points, i.e. one value per 
point). Assembling these n m-vectors into an n by m matrix provides an interpretation 
where each row corresponds to a transformation. The matrix then can be viewed as a 
matrix of coefficients of a system of equations that can be solved for field or 
transformation values." Paragraph 220 states, "Yet another approach is to scale the 
strength fields animated by the morph parameters varying from zero (no deformation) to 
1 (full deformation)." Therefore, Milliron teaches of a scale value varying from zero to 
one with which to scale the associated strength vectors. As stated in Paragraph 77, the 
warp designer is able to set the specifications of the features to be modified. Thus, 
Milliron discloses applying the warping tool using a user specified scale factor, the scale 
factor being used to scale the strengths associated with the vectors. 

In regard to claim 19, the same basis and rationale for claim rejection as applied 
to claim 3 is applied. 

In regard to claim 20, the same basis and rationale for claim rejection as applied 
to claim 4 is applied. 

In regard to claim 21 , the same basis and rationale for claim rejection as applied 
to claim 5 is applied. 

In regard to claim 26, the same basis and rationale for claim rejection as applied 
to claim 10 is applied. 

In regard to claim 27, the same basis and rationale for claim rejection as applied 
to claim 1 1 is applied. 
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In regard to claim 29, the same basis and rationale for claim rejection as applied 
to claim 13 is applied. 

In regard to claim 30, the same basis and rationale for claim rejection as applied 
to claim 14 is applied. 

In regard to claim 31 , the same basis and rationale for claim rejection as applied 
to claim 15 is applied. 

In regard to claim 32, the same basis and rationale for claim rejection as applied 
to claim 16 is applied. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

U.S. Patent No. 5,175,808 to Sayre 

U.S. Patent No. 5,796,400 to Atkinson et al. 

U.S. Patent No. 6,204,860 to Singh 

U.S. Patent No. 6,377,712 to Georgiev et al. 

U.S. Patent No. 6,448,964 to Isaacs et al. 

U.S. Patent No. 6,867,770 to Payne 

U.S. PGPUB No. 2004/0156556 to Lopez 
Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Blake E. Betz whose telephone number is (571) 272- 
7655. The examiner can normally be reached on 7:30 - 4:00 M-F. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi can be reached on (571) 272-7664. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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